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(54) A method for displaying spatially offset images using spatial Light modulator arrays 

(57) A method for displaying spatially offset images 
using spatial light modulators. A first spatial light modu- 
lator image (10) is overlaid with a second spatial light 
modulator image (12) slightly offeet from the first image 
such that the resulting image has higher resolution than 
the spatial light modulator. One or two devices may be 
used in static imaging. In imaging video data, two 
devices will he used, with the components of the incom- 
ing data being divided between them. 
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Description 

BACKGROUND OF THE INVENTION 

This invention relates to imaging systems, more particularly to those that use spatial light modulator arrays of indi- 
vidual elements. 

BACKGROUND OF THE INVENTION 

Currently the starriard for most ^ 
isthe laser-polygon scanner system. However, the use of spatial light modulators in both of these areas has grow .con- 
siderably in recent years. Examples of spatial light modulators with arrays of irKfrv^^ 

particularly suited far imaging include liquid crystal devices (LCD), cfigital micromirror devices (DMD™). and actuated 

m ^^^esofr^ula^ give individual control of each picture element (pixel) of thef inal image, whether thefinal 
image is a video or st>u display, or a printed image. Since most of these modulators act in either a digital (ON/OFF) fash- 
ion, or can mimic that mode, the use of high-speed and performance digital processors on the image data can improve 
the picture dramaficaOy- 

One of the more noticeable artifacts involved with these modulators occurs when they render curved surfaces or 
no diagonals. Because these arrays are typically laid out in a square or rectangular grid tor ir^ufecturing reason* Jhejr 
images follow these grid lines. When rendering a diagonal or curve, the resulting image has a staircase or step effect 
sometimes referred to as Jaggies. 

These artifacts can be reduced with higher resolution devices, essentially increasing the number of elements avert- 
able for the Imaga Additionally, higher resolution displays allow the display of more information content. However, the 
2S more elements on the device, the more compfex to manufacture, which in turn results in higher costs. At some pant, 
these extra costs become prohibitive. 

Therefore, some method is needed to allow higher resolution imaging without requiring higher resolution devices. 



5 



10 



15 



30 



SUMMARY OF THE INVENTION 

One aspect of the invention is the use of two spatial light modulator arrays in tandem, where the images of the t*o 
arrays are offset from one another by a half pixel width and a half pixel height Trie resulting image is perceived to be 
higher resolution, without requiring high resolution devices. The sarnpBng and processing for each of these devices 
must be coordinated and timed such that if used for video data the incoming data Is rendered accurately 
s$ It is an advantage of the invention in that it allows higher resolution images to be formed without requiring higher 

it is a further advantage of the invention that a higher resolution image can he achieved, thereby allowing the dis- 
play of more image content, without requiring higher resolution devices. 

40 BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention and for further advantages thereof, reference is now 
made to the following Detailed Description taken in conjunction with the accompanying Drawings in which: 

45 Figure 1 shows images of two modulator arrays offset by one half a pixel widfli and one half a pixel height in accord- 
ance with the present Invention; 

Figure 2 shows an exploded view of one set of pixels of Figure 1 offset by one half a pixel width and one half a pixel 
height; 

Figures 3a-3c show alternate embodiments of sampling incoming video data and one embodiment of displaying 
this data on offset spatial light modulators; 

Figure 4 shows a color wheel for use with the embodiments illustrated in Figures 3a*c; and 
Figures 5 shows graphically one embodiment of displaying interlaced video data on offset modulators. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In Figure 1. an example of two images of one or two spatial Bgtt modulator* is showaAs^n be seer i the ^g<J 

are offsefbr one halt the pixel width and one ^P^^^^^^^^SSSm 
ration but is not intended to limit the offset parameters in any way. The pixels couW be offset any width and nagnt or 

the pixels, but will be less than one full pixel width or one lull pool height. 

The ftrt spatial light modulator array image 1 o is imaged onto a surface, either a display surface or a printing sur- 

tbTarray or arrays are offset If one array is used to generate both images, then ^.ously the 
itself, it two arrays are used, they do not have to be offset in any special way. so long ^ they <^^«^£™2 
configuration. In the case of using two transparent arrays, such as transm.ss.ve LCD panels. H may be desirable to 
physically offset the arrays themselves. . 

In Rmire 2 an exploded view of the image from Figure 1 has been taken along the intersection of Tines a and a in 
Figure 1 As is show in this view, the original four pixels 14. 16. 18 and 20 now have subregions thatare ^' 1 ™ rt ^ «J 
various combinations of pixels. Pixel 1* has two regions. 14a and 14b- Region 14a has ^^^.^^ 
1/4ths the p«al 14 on the first modulator array. Region 14b has the brightness and color of 3/41h the h^htness ad 
color of pM 14 on the first modulator image, and 1/4th the brightness and color of pixel 14 on toe ^rxJ ^ator 
image. Pixel 16 has three regions, 16a. 16b, and 16c Region 160 has 1/2 the brightness arxi color erf *e 
first modulator image. Region leahas l/4th the brightness and color of pixel 14 from the second mcdu^&r^and 
region 16b has l/4th the brightness and color of pixel 16 from the second modulator image. Region 18 has the same 

typecfrtirpoertioabutirist^ . , on ^ 4hn#irctmi¥ i 

Pixel 20 has four regions. 20a. 20b. 20c. and 20d. Region 20a is wmpneed of 1/4* of pixel 20 rfromthe , frt mod- 
ulator image and i/4th of 1/41h pixel l4from the second modulator image. Region 20b has 1/4* , of >xel 20 fromttie 
first modulator image and V4th of the pixel 16 from the second modulator image. Region 20c has 1/4th of raxel » from 
thefirst modiJator Image and 1/4th toe pixel 1 8from the second modulator image. Region 20d has 1/4th of pixel 20 from 

the first modulator image and l/4th the pixel 20 from the second modulator image. . 

In actuality, these regions are no longer part of their respectivepixers fromthefirst modulator image when risptyed 
or imaged. The perception wiD be that each region is in and of itself Hs own pixel. In this manner the higher resolution 
Is achieved 

For imaging applications where the data is static, the data is merely sent to the spatial Oght modulator arrays in 
coiorformat In most printing application the colore will be cyan, magenta, yellow and black The applicai»on could also 
use onfy black modulated for shades of gray for monochrome pictures. . . 

The incoming picture is sampled however necessary to most closely copy the picture- The date resulting from me 
sampling is then sent to an area array modulator, which creates the image on its face and images it onto a surface, 
which could be a printing substrate such as photographic film. The substrate is then 'expose* again, the second pag- 
ing offsets the array by one pixel width and one pixel height The resulting picture then has a perceived resolution of 
twice that of the device or devices used to create it .^^^ 

The above discussion is only intended as a specific example and is in no way intended to limit other metnoas ot 
imaging data tor printing applications. For example, color printing has several ways to register the other colors for each 
pixel in the same space, such as applying aQ colors at once, or creating the entire line in one color and then adding the 
entire line in the other colors. Additionally, exposure of color film allows for several different approaches. 

One toy difference between printing applications and display applications is In the continuously flowing data stream 
of video applications. The incoming data to the display device can be in one of several formats. In the typical system, 
the incoming data must be sampled for display on an area array spatial light modulator, since each modulator elements 
require pixel specifK; infomnation. typicaliy i^ r 

Figure 3a shows one embodiment of a sampling approach. Note that the colors in the video application are 
assumed to be split between the two modulators, rather than displaying all three colors on both. This saves bandwidth 
and processing power, and results in the same perceived colors, because the human eye cannot differentiate shades 
of colors beyond a certain point It is therefore advantageous to use two modulators to lower the processing and band- 
width requirements- These divisions could be any other combination of the three colors and is only intended to be an 

For another possibility, both modulators could display RGB data. Various color combinations can be created to opti- 
mize the overall display for color separation. In one embodiment illustrated in Figure A, using one color wheel and two 
modulators, the color wheel is divided into four segments. 1# green, t/3 blue, and 2 x 1/6 red segments. 

Both modulators would display red at the same time, while in the next segment, one would display green, the other 
blue- Obviously, other combinations of the colors could be used in this same configuration. 

Additionally, the system could use two offset modulators with two color wheels. Tne modulators would be illumi- 
nated such that the first modulator would be receiving red fight while the other is receiving green light, with the seg- 
ments cycling from red to green to blue to red. The colors displayed would then be: 
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Red (modulator 1) + Grean (modulator 2) ■ Yellow 

Blue (modulator 1) + Red (modulator 2) = Magenta 

Green (modulator i) + Blue (modulator 2) = Cyan. 

The continuity between toe reds, blues and greens between the two modulators can be used to pr<^e M^Hmen- 
ttry bit split timing helping with artifact megaton. Other methods of positioning and color spGttmg can be used to nth 

^SSS^t^^^^^^ 3 ^ to induce hues. Edwin Land, in photography ^mente. induced 
the SSSS^A greens by filtering animage with a green filter, and projecting it with clear light. 

SC^^terandprnj*^ 

used 4induce huesSi toe final image- All of these possibilities of using two modulators must be coordinated 

with the sampling and processing of the data before display. m-***,*-,* wni k« 

In Figure 3a the sampling clocks are set up to be offset by one half a sample period Tl«s *^™^ ^J* 
referred K "phase offseT sampling. Assume for discussion purposes that the two spabal light rrwdutetors *e 640 
tS^tSl 480 «J5»im» R1. R2, G1.G2 and B1, B2 ** 
takeaAaain this is for an example where the color division between the modulators is red and flreen^lue- 

wSiU Sen brayed on the modulators as shown in Figure 3b. Pix4 32 would be « ™^ p«* 34 
would be G2/B2. Pixels 36 and 38 would be Rl and R2 respectively Note that tos^rms ^erlac^ da^ ^ toat 
only half of toe 480 lines is received at a given time, either the odd or toe even numbered lines, '"^f^^ 
full 480 lines of data, toe data will have to be line doubled for each modulator, as is shown m W ^The P^offeet 
I^cktoeleast expense appr^^ 

for th 8( ^ard toe data re displayed on toe appr^^ • 

Figure 3c shows an embodiment that win require some interpolation. In to.s embodiment the ^ampl* ^ are 
aligrj. and hence will be referred to as the "phase aligned' approach. The samples are taken ^^gn^bythe 
Smws rl. r2. gi, rA M and b2. Interpolation is then used to create toe offset samples for ertherthe red modulator or 
toe green/Wue modulator. . . „ h . 

One example of interpolation uses the four surrounding pixels of the pixel to be created as shown below. 



rl • r2 

• rl' 
r3 • r4. 
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The formula to find r1' is: n'= 1/4(r1-H2+r3+r4) .• 
Other moresophisti^edfiheismaybeusedtoachieve more accurate date values JMM«npraadi «^P^ 
more accurate than toe phase offset approach, shown in Figure 3a. it involves the extra cost of .rterpolaton. This data 
r uW Zbe Slaved similarly to toe method shown in Figure 3b. except that toe pixels 32 and 34 would now be 
at /b1 and b2/h2. respectively, and pixels 36 and 38 would be pixels ii ' and r2*. respectively. .. . 

In addition to using two 640 x 480 arrays to display data at 1280 x 960 
could be used to achieve toe 640 x 480 resolution In this example the dances would have 320 elements per row wrm 
240 rows This is especially applicable to interfaced data, where the arrays are closer to the field dimensions, where two 
fields make ud one trame of data. Each field in interlaced data contains only half of toe lines for thai tframe. 

Since odd and even fields are spatially offset from each other, toe spatial positioning of one of * e J^f>«* 
ideal for displaying the Odd field data and toe other tor Even field data as shown in Figure 5. Howev^Jo^ay Odd 
field data on the green/Hue modulator and Even field data on the red modulator, interpolaton is i needed to obtain toe 
samplesinthecc^ectspatiallocatioaThus.inRgureS. GV= 1V2(GH<32> and BV= 

the data was sampled using the phase offset sampling method. If toe phase aligned approach is used toe pixels G1 
and BV would be interpolated as discussed above tor rT and r2\ . , . h 

Acain botfi the division of colors between green/blue and red. and toe decision as to which color will display vvnicn 
field are intended only as examples, m summary, for this example, the Odd field will be displayed with onginal dafa on 
toe red modulator and interpolated data on the green/blue modulator. The Even field will be displayed with original data 
on the green/blue modulator and the interpolated data on toe red modulator. 

In the above discussion several choices were made in order to make the discussion easier. For e^'^e ^ 
cussion has assumed that me toll frame of data for interlaced signals will be achieved by fine doubling. However, there 
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are several other way* to perform irrtertace-tc^rogressive-scan conversion. With the use of a moAittM- thai is WO x 
460 motion adaptive progressive scan methods can be used . Examples of these methods can be found m i forther detai 
in US Patent Nas 5,550.592 and 5,519,451 and in Published European Patent Document Na EP 0,740,465. 

Far these techniques to work correctly, the RGB data is sampled according to the phase offset technique, orthe 
phase aligned technique plus the required interpolation prior to the application of those methods. For the smaller mod- 
ulators for field displays (320 x 240). only one field of data can be displayed at a time. While the progressive scan will 
not be performed to produce one full framo of data, the interpolated data can be created using those techniques. 

Similarly, with regard to the dimensions of the devices, scaling technics can be used on the RGB data for the 640 
x 480 devices. Again the data must be sampled by phase offset or by phase aligned plus the interpolation, prior to the 
scaling techniques being applied. Examples of these scaling techniques are shown in greaterdetail in Publishea^urc- 
p*an Patent Document No* EP 0,700.015 and 0.700.016. For the 320 x 240 devices, only one field is displayed at a 
time, and separate filter coefficients are used for scaling the field data. 

Another choice that was made previously to the discussion that erf workngwim RGB data. ratherthanYC data- 
in YC space, the color channel information is encompassed in the YC components, as follows; 



Red = 1.164(Y-16) + 1.596(GM28) 
Green = 1.164{Y-16) - 0,813(Cr-128) - 0.391 (Cb-1 28) 
a, Blue * 1.164<Y-16) +2.018(Cb-128) 

(assuming aCCIR60l format where the input range of 16-234 gets expanded to 0^255. The coetffcents differ if the 

input range Is 0-255). _ . _ . ... 

By using phase offset sampling, the Cr will be sampled offset from the Y/Cb sampling as shown in Figure 3a, with 
25 red being Grand the green/blue being Y/Cb. The Y data needed to create red samples and Cr data needed to create 
green samples can then be generated by using interpolation as shown above. 

If one were to use the phase aligned approach, as shown in Figure 3c, the VlCr data needed to generate red sam- 
ples is then obtained by interpolation as above. 

Finally, using either phase afigned or phase offset sampling and using the samples in the equations above, the sys- 
so tern can generate the RGB data. This data is then used as discussed above. 

The video processing mode ften is far more complex than the static image processing. Additionally, m video 
processing the images will be created with two devices, while static imaging requires two images, rather than two 
devices. However, both have the ability to create higher resolution images using lower resolution devices. This keeps 
* the cost of device manufacture lower, thereby lowering system cost # 
55 Thus, although there has been described to this point a particular embodiment for a method and structure for imag- 
ing with offset spatial light modulators, it is not intended that such specif ic references be considered as limitations upon 
the scope of this invention. 
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Claims 

1. A methcxi of high resolutions 

providing data to be formed into a final image to an imaging system; 

creating a first image of said data onto a substrate using a spatial light modulator of a resolution that forms pix- 
4s els of a predetermined width and height; and 

creating a second image of said data onto said substrate using a spatial fight modulator of a resolution such 
that said second image is offset from said first image less than said width and said height of one of said pixels, 
thereby creating an image with a higher resolution than said given resolution-. 

6o 2- A method for displaying video data using spatially offeet spatial light modulator images, comprising the steps oft 
receiving incoming video data; 

dividing said video data into components between a first and a second spatial fight modulator, sad first and 
second spatial light modulators have pixels of a given width and height; 
55 sampling said video data; 

displaying samples of one of said components on said first spatial light modulator; 

displaying samples of others of said components on said second spatial light modulator, such that said display- 
ing step results in an image of said one of said components being offeet from an image of said other of said 
components by less than said width and said height of a pixel. 
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(57) A method for displaying spafelly offset images 
using spatial light modulators, A first spatial light modu- 
lator image (10) is overlaid with a second spatial light 
modulator image (12) slightly offset from the first image 
such that the resulting image has higher resolution than 
the spatial light modulator. One or two devices may be 
used in static imaging. In imaging video data, two 
devices will be used, with the components of the incom- 
ing data being divided between them. 
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